Skip to content

Conversation

abukhoy
Copy link
Contributor

@abukhoy abukhoy commented Jul 28, 2025

This PR updates the following dependencies to their latest CPU-only versions:

  • PyTorch: 2.7.1+cpu
  • Torchvision: 0.22.1+cpu

Additionally, it updates the Python version requirement to:

  • Python: >=3.9

Reference: https://pytorch.org/get-started/previous-versions/

Testing

  • Multimodal Example Scripts have been tested successfully, such as Llama4, gemma3, whisper, granite vision, intern, mLlama.

  • The following Causal models have been tested and verified to work correctly with the updated dependencies:

  • DeepSeek-R1-Distill-Qwen-32B

  • EleutherAI/gpt-j-6b

  • OpenGVLab/InternVL2_5-1B

  • bigcode/starcoder

  • bigcode/starcoder2-15b

  • codellama/CodeLlama-13b-hf

  • codellama/CodeLlama-34b-hf

  • codellama/CodeLlama-7b-hf

  • google/codegemma-2b

  • google/codegemma-7b

  • google/gemma-2-27b

  • google/gemma-2-2b

  • google/gemma-2-9b

  • google/gemma-2b

  • google/gemma-7b

  • ibm-granite/granite-20b-code-base-8k

  • ibm-granite/granite-20b-code-instruct-8k

  • ibm-granite/granite-3.1-8b-instruct

  • ibm-granite/granite-guardian-3.1-8b

  • inceptionai/jais-adapted-13b-chat

  • inceptionai/jais-adapted-7b

  • lmsys/vicuna-13b-delta-v0

  • lmsys/vicuna-13b-v1.3

  • lmsys/vicuna-13b-v1.5

  • meta-llama/Llama-2-13b-chat-hf

  • meta-llama/Llama-2-7b-chat-hf

  • meta-llama/Llama-3.1-8B

  • meta-llama/Llama-3.2-1B

  • meta-llama/Llama-3.2-3B

  • meta-llama/Meta-Llama-3-8B

  • microsoft/Phi-3-mini-4k-instruct

  • mistralai/Codestral-22B-v0.1

  • mistralai/Mistral-7B-Instruct-v0.1

  • mistralai/Mixtral-8x7B-Instruct-v0.1

  • mistralai/Mixtral-8x7B-v0.1

  • mosaicml/mpt-7b

  • openai-community/gpt2

  • tiiuae/falcon-40b

  • Qwen/Qwen2-1.5B-Instruct

@quic-hemagnih
Copy link
Contributor

Lets run CI and all the models manually which are not currently covered under CI. Once all are passing then we can go ahead and merge it.

@abukhoy abukhoy changed the title Update PyTorch to 2.7.0+cpu, Torchvision to 0.22.0+cpu, and Python Requirement to >=3.9 Update PyTorch to 2.7.1+cpu, Torchvision to 0.22.0+cpu, and Python Requirement to >=3.9 Aug 7, 2025
@abukhoy abukhoy changed the title Update PyTorch to 2.7.1+cpu, Torchvision to 0.22.0+cpu, and Python Requirement to >=3.9 Update PyTorch to 2.7.1+cpu, Torchvision to 0.22.1+cpu, and Python Requirement to >=3.9 Aug 12, 2025
@@ -24,7 +24,7 @@ pipeline {
pip install .[test] &&
pip install junitparser pytest-xdist &&
pip install librosa==0.10.2 soundfile==0.13.1 && #packages needed to load example for whisper testing
pip install --extra-index-url https://download.pytorch.org/whl/cpu timm==1.0.14 torchvision==0.19.1+cpu einops==0.8.1 && #packages to load VLMs
pip install --extra-index-url https://download.pytorch.org/whl/cpu timm==1.0.14 torchvision==0.22.1+cpu einops==0.8.1 && #packages to load VLMs
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please update readme file of internvl and other VLMs as well with updated versions of these packages.

@quic-hemagnih
Copy link
Contributor

Where are we on this PR?, Have we executed all the CI test cases and models which are not covered in CI?

@abukhoy
Copy link
Contributor Author

abukhoy commented Sep 1, 2025

Where are we on this PR?, Have we executed all the CI test cases and models which are not covered in CI?

Few Vision-Language Models are remaining to test such as Llama4 and Gemma3, these are getting tested as these are big models getting machine issue sometimes. Although these are present in CI with single or double layer, but I am testing full models locally.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants